Composition assisting apparatus and composition assisting system

ABSTRACT

[Object] To provide communication space for the user to have crossing over of discussions with respect to plural phrases while allowing the discussions to be conducted individually in parallel. 
     [Means for Solution] A module for generating phrase object (FO) data which contain identification information of phrase data and position information of a FO on a chat canvas (CC), a module for generating chat data which contain message text data and display position information on CC, a module for transmitting the chat data to a server, and receiving the chat data distributed from the server, a module for transmitting the FO data to the server and receiving the FO data distributed from the server, and a module for displaying the FO or the message text on the CC based on the FO data or the chat data are provided. The display mode of the message text is determined based on the display mode of the FO located close to the display position of the message text.

TECHNICAL FIELD

The present invention relates to an assisting tool and an assistingsystem for composing by combining phrases, and more particularly, to acomposition assisting tool and a composition assisting system effectivefor plural users to compose collaboratively.

BACKGROUND ART

A frame-base composition tool is well known as the tool operated in theinformation processor such as a personal computer to compose bycombining desired phrases selected from prepared phrases of a pluralityof instruments (Non-Patent Document 1).

The phrase-forming tool which allows plural uses to create the phrasecollaboratively via the network has also been distributed (Non-PatentDocument 2). The phrase-forming tool has realized the communicationamong plural users via the text chat system for creating the phrasewhile allowing those users to share the information.

[Non-Patent Document 1]

“GarageBand3”, [online], <URL:http://www.apple.com/ip/ilife/garageband/> searched on Aug. 29, 2006.

[Non-Patent Document 2]

“TransJam-Jammin' on the Web!” [online], <URL:http://www.transjam.com/webdrum> searched on Aug. 29, 2006.

DISCLOSURE OF INVENTION Problems to be Solved by the Invention

The inventors of the present invention have the following findings afterstudying on the composing method which allows plural users tocollaborate in the frame-base composition (hereinafter referred to as“collaborative frame-base composition method”) via the network bycombining desired phrases selected from prepared plural phrases sharedby those uses.

In the case where the plural users collaborate in the frame-basecomposition, if each of the plural phrases to compose the music isdiscussed individually in parallel, the composition may be efficientlyconducted while sufficiently discussing about the respective phrases.Meanwhile, it is preferable to proceed the composition by crossing overof discussions on the respective phrases which are closely related withone another as parts of the piece of music.

It has been found that the conventional chat system as disclosed inNon-Patent Document 2, specifically, the chat system having the messagesinput by the users displayed on the chat window in descending order(along one-dimensional time axis) fails to provide the communicationspace suitable for the collaborative frame-base composition method, andis unable to sufficiently assist the composition for the reasonsdescribed below.

Assuming that the conventional chat system is used to allow the users todiscuss about plural phrases in parallel using a single chat window,discussions on the plural phrases may be mixed on the single chatwindow. This makes it difficult for the users to discuss about therespective phrases individually. Meanwhile, the conventional chat systemallows the users to discuss about the respective phrases individually inparallel using the plural chat windows. In the aforementioned case,however, discussion about each of plural phrases will be closed withineach window, and accordingly, crossing over of the discussions aboutvarious phrases cannot be made.

It is an object of the present invention to provide a new frameworkwhich allows appropriate composition assistance by realizingcommunication space suitable for the collaborative frame-basecomposition in terms of being able to make users cross over ofdiscussions with respect to plural phrases appropriately while allowingthe discussions to be conducted individually in parallel.

Means for Solving the Problems

A composition assisting apparatus according to the present inventionincludes a phrase object set module for forming phrase object data whichcontain at least identification information of phrase data designated bya user, and position information of an object for indicating a positionwhere a phrase unit discussion is opened (hereinafter referred to as“phrase object”) on a two-dimensional region (hereinafter referred to as“chat canvas”) upon reception of a command for opening a discussiondesignating the phrase from the user, a chat data input module forgenerating chat data which contain at least text data of a message inputby the user, and display position information on the chat canvas uponreception of a command for inputting the chat data from the user, a chatdata management module for transmitting the generated chat data,receiving the chat data distributed from the server and storing the chatdata in a memory, a phrase object data management module fortransmitting the generated phrase object data to the server, receivingthe phrase object data distributed from the server, and storing thephrase object data in the memory, and a display module for displayingthe phrase object or the message text data on the chat canvas based onthe phrase object data or the chat data stored in the memory. A displaymode of the message text data is determined based on a display mode ofthe phrase object located close to a display position of the messagetext data.

Preferably, the apparatus includes a phrase data acquisition module foracquiring the phrase data from a database for storing the phrase data incorrelation with phrase identification information based on the input bythe user and storing the phrase data in the memory, and a player modulefor playing the phrase data stored in the memory.

Preferably, the apparatus further includes a music data creation modulefor creating music data by combining the acquired phrase data, and amusic data management module for transmitting the created music data tothe server, receiving the music data distributed from the server, andstoring the music data in the memory. The player module plays the musicdata stored in the memory.

A composition assisting system according to the present inventionincludes at least one server and a plurality of terminals. The terminalincludes a phrase object set module for generating phrase object datawhich contain at least identification information of phrase datadesignated by a user, and position information of an object forindicating a position where a phrase unit discussion is opened(hereinafter referred to as “phrase object”) on a two-dimensional region(hereinafter referred to as “chat canvas”) upon reception of a commandfor opening the discussion designating the phrase from the user, a chatdata input module for generating chat data which contain at least textdata of a message input by the user and display position information onthe chat canvas upon reception of a command for inputting the chat datafrom the user, a chat data management module for transmitting thegenerated chat data to the server, receiving the chat data distributedfrom the server, and storing the chat data in a memory, a phrase objectdata management module for transmitting the generated phrase object datato the server, receiving the phrase object data distributed from theserver, and storing the phrase object data in the memory, and a displaymodule for displaying the phrase object or the message text data on thechat canvas based on the phrase object data or the chat data stored inthe memory. The server includes a phrase object data management servermodule for receiving the phrase object data from the terminal, storingthe received phrase object data in a memory, and distributing the storedphrase object data to the terminal. A display mode of the message textdata is determined based on a display mode of the phrase object locatedclose to the display position of the message text data.

A phrase base composition assisting method according to the presentinvention includes a phrase object set step for generating phrase objectdata which contain at least identification information of phrase datadesignated by a user, and position information of an object forindicating a position where a phrase unit discussion is opened(hereinafter referred to as “phrase object”) on a two-dimensional region(hereinafter referred to as “chat canvas”) upon reception of a commandfor opening the discussion designating the phrase from the user, a chatdata input step for generating chat data which contain at least textdata of a message input by the user and display position information onthe chat canvas upon reception of a command for inputting the chat datafrom the user, a chat data management step for transmitting thegenerated chat data to the server, receiving the chat data distributedfrom the server, and storing the chat data in a memory, a phrase objectdata management step for transmitting the generated phrase object datato the server, receiving the phrase object data distributed from theserver, and storing the phrase object data in the memory, and a displaystep for displaying the phrase object or the message text data on thechat canvas based on the phrase object data or the chat data stored inthe memory. A display mode of the message text data is determined basedon a display mode of the phrase object located close to the displayposition of the message text data.

The program (program product) according to the present invention allowsthe computer to execute respective steps of the composition assistingmethod according to the present invention. The program (program product)according to the present invention may be installed or loaded in thecomputer through various types of recording medium such as the CD-ROM,the magnetic disk, and the semiconductor memory or by downloading viathe communication network.

In the description, the module represents not only the physical devicebut also execution of at least a part of the function of the module bythe software. The function of the single module may be realized by twoor more physical devices, or functions of two or more modules may berealized by the single physical device.

Advantages

The present invention provides the new framework which allowsappropriate composition assistance by realizing the communication spacesuitable for the collaborative frame-base composition in terms of beingable to make users cross over of discussions with respect to pluralphrases appropriately while allowing the discussions to be conductedindividually in parallel.

BEST MODE FOR CARRYING OUT THE INVENTION

An embodiment of the present invention will be described referring tothe drawings.

FIG. 1 is a block diagram schematically showing a composition assistingsystem 100 as an embodiment of the present invention. Referring to thedrawing, the composition assisting system 100 includes a compositionassisting server 1 and plural composition assisting terminals 2 a to 2 dcorresponding to users who participate in the composition project,respectively. The composition assisting server 1 and the respectivecomposition assisting terminals 2 a to 2 d (hereinafter referred to as“composition assisting terminal 2” when distinction is not required.)are mutually communicated with one another via a predeterminedcommunication network N (LAN, internet, exclusive line, packetcommunication network, and an arbitrary combination thereamong, andincluding wired and wireless). Each number of the composition assistingserver 1 and the composition assisting terminal 2 may be changed inaccordance with the design.

FIG. 2( a) is a block diagram of a hardware structure of the compositionassisting server 1. Referring to the drawing, the composition assistingserver 1 may be formed of a general-purpose computer which includes suchhardware as the CPU, ROM, RAM, external storage unit, user interface,display and communication interface. The composition assisting server 1may be formed of the single computer or plural computers distributed onthe network.

FIG. 2( b) is a block diagram showing a main function structure of thecomposition assisting server 1. Referring to the drawing, thecomposition assisting server 1 includes a phrase database 10 whichstores various phrase data and a phrase data supply module 11 whichoutputs the phrase data stored in the phrase database in response to thedownload request from the composition assisting terminal 2 for thepurpose of allowing users to share the phrase data.

The server further includes a music data management server module 13which receives the music data from the composition assisting terminal 2,stores/manages the received music data in a music data storage servermodule 12, and performs multi-address transmission (distribution) of themanaged music data to the respective composition assisting terminals 2for the purpose of allowing the users to share the music data for thecollaborative composition.

The format for the phrase data and the music data may be determined inaccordance with the design. In the embodiment, MIDI (Musical InstrumentDigital Interface) is employed as the format for the phrase data and themusic data. The phrase database 10 preliminarily stores plural MIDI typephrase data with respect to four kinds of instruments, that is, guitar,drum, piano, and bass guitar. FIG. 4 shows an exemplary data structureof the phrase database 10.

Referring to FIG. 2( b), the composition assisting server 1 includes thesame function structure as that of the generally employed chat serverfor the purpose of providing the communication space for the users toshare the information. Specifically, the server includes a chat datamanagement server module 15 which receives the chat data and variousrequests from the composition assisting terminals 2, and stores/managesthe received chat data in a chat data storage server module 14 fordistributing the managed chat data to the respective compositionassisting terminals 2, etc.

The composition assisting server 1 of the embodiment is formed byexpanding the function of the generally employed chat server so as to beadapted not only to the generally employed chat system but also adaptedto the two-dimensional chat system capable of displaying the message onthe arbitrary position on the two-dimensional window region (hereinafterreferred to as the chat canvas”).

The two-dimensional chat system formed as the embodiment is structuredto provide the object indicating the location of the discussion for eachphrase (hereinafter referred to as “phrase object”) on the chat canvas.The composition assisting server 1 includes a phrase object datamanagement server module 17 which receives the phrase object data thatcontain at least the phrase data identification information and phraseobject position information on the chat canvas from the compositionassisting terminal 2, and stores/manages the received phrase object datain a phrase object data storage server module 16 for distributing thestored phrase object data to the respective composition assistingterminals 2.

Each of the function modules of the composition assisting server 1 isrealized by the CPU which executes the predetermined program stored inthe ROM, RAM, external storage unit, etc.

FIG. 3( a) is a block diagram showing the hardware structure of thecomposition assisting terminal 2. Referring to the drawing, thecomposition assisting terminal 2 may be formed of the general-purposecomputer which includes such hardware as the CPU, ROM, RAM, externalstorage device, user interface, display, MIDI sound source, speaker andcommunication interface. The mobile terminal may be employed as thecomposition assisting terminal 2 instead of the general-purpose personalcomputer.

FIG. 3( b) is a block diagram showing a main function structure of thecomposition assisting terminal 2. Referring to the drawing, thecomposition assisting terminal 2 essentially includes the same functionsas those of the generally employed phrase-base composition tool, forexample, a player module 22 for playing phrase data stored in a phrasedata storage module 20 and the music data stored in a music data storagemodule 21, and a music data creation module 23 for creating the musicdata by combining the phrase data stored in the phrase data storagemodule 20 (including the case for additionally combining the phrase datawith the music data in process of creation).

The composition assisting terminal 2 of the embodiment includes a phrasedata acquisition module 24 which transmits the download requestdesignating the phrase data to the composition assisting server 1,acquires the phrase data transmitted from the composition assistingserver 1 in response to the request, and stores the acquired phrase datain the phrase data storage module 20, and a music data management module25 which transmits the created music data to the composition assistingserver 1, and stores/manages the music data distributed from thecomposition assisting server 1 in the music data storage module 21 forthe purpose of allowing the users to share the phrase data and the musicdata.

The composition assisting terminal 2 of the embodiment includes the samefunction structure as that of the generally employed chat terminal forthe purpose of providing the communication space for the users to sharethe information. Specifically, the terminal includes a chat data inputmodule 26 which receives chat data including message text data, andvarious requests from the user, a chat data management module 28 whichtransmits the input chat data and various requests to the compositionassisting server 1, and stores/manages the chat data distributed fromthe composition assisting server 1 in a chat data storage module 27, anda chat canvas display module 29 which displays the message text data onthe chat canvas based on the chat data stored in the chat data storagemodule 27.

The composition assisting terminal 2 of the embodiment is formed byexpanding the function of the generally employed chat terminal so as tobe adapted to the two-dimensional chat system likewise the compositionassisting server 1 (that is, each module is allowed to process the chatdata containing at least the message text data and the positioninformation on the chat canvas).

The two-dimensional chat system formed by the embodiment is structuredto provide the phrase object on the chat canvas. For this, thecomposition assisting terminal 2 has the following structure.

That is, the composition assisting terminal 2 includes a phrase objectset module 30 which generates the phrase object data upon reception ofthe command for opening the discussion designating the phrase from theuser, and a phrase object data management module 32 which transmits thegenerated phrase object data to the composition assisting server 1, andstores/manages the received phrase object data distributed from thecomposition assisting server 1 in a phrase object data storage module31.

The chat canvas display module 29 is structured to display the phraseobject on the chat canvas based on the phrase object data stored in thephrase object data storage module 31.

The display mode of the message text data to be displayed by the chatcanvas display module 29 is determined based on the display mode of thephrase object close to the display position of the message text data.

Each of the function modules of the composition assisting terminal 2 maybe realized by the CPU which executes the predetermined program storedin the ROM, RAM, external storage unit, etc.

The framework of the collaborative composition realized by thecomposition assisting system 100 will be described referring to theflowcharts and explanatory views shown in FIGS. 5 to 10. Each step(including sub-step which is not designated with the code) may beexecuted in the changed order or in parallel so as not to causecontradiction to the processing content.

(Downloading/Trial Listening of Phrase Data: FIGS. 5( a), (b))

The phrase data acquisition module 24 of the composition assistingterminal 2 which is active is kept standby until the user inputs thedownload command of the phrase data (S100).

Various types of process for inputting the download command of thephrase data may be employed in accordance with the design. For example,the phrase data list stored in the phrase database 10 may bepreliminarily acquired to be displayed on the pull-down menu such thatthe user is allowed to select the desired phrase data from the list.

In the embodiment, upon selection of the phrase data, the user isallowed to designate the incorporation point at which the selectedphrase data are incorporated in the music data to be composed. The musicdata of the embodiment are structured to correlate each number of thepredetermined unit time (hereinafter referred to as “time line”) orderedin sequence along the time axis with the phrase data. So theincorporation point of the phrase data to be incorporated in the musicdata may be designated using the time line number.

When the download command of the phrase data is input, the phrase dataacquisition module 24 generates the download request to contain theidentification information of the selected phrase data and transmits itto the composition assisting server 1 (S101). The identificationinformation of the phrase data may be formed of the instrumentidentification and the phrase identification, for example.

Upon reception of the download request from the composition assistingterminal 2 (S102), the phrase data supply module 11 of the compositionassisting server 1 extracts the phrase data identification informationfrom the received download request, reads the phrase data correspondingto the extracted phrase identification information from the phrasedatabase 10 (S103), and transmits the read phrase data to thecomposition assisting terminal 2 which has transmitted the downloadrequest (S104).

Upon reception of the phrase data from the composition assisting server1 (S105), the phrase data acquisition module 24 stores the receivedphrase data in correlation with the phrase data identificationinformation in the phrase data storage module 20 (S106). FIG. 7 shows anexemplary data structure of the phrase data storage module 20.

Then the music data creation module 23 reads the music data from themusic data storage module 21 to incorporate the combination of thestored phrase data and the incorporation point (time line number) to themusic data designated upon the download command in the read music datato create the temporary music data (S107). This is the end of the phrasedata downloading process.

The temporary music data may be created by acquiring plural phrase data.In the case where the download command is input with respect to thedownloaded phrase data (that is, stored in the phrase data storagemodule 20), the phrase data commanded to be downloaded are read from thephrase data storage module 20 for creating the temporary music datawithout transmitting the download request.

Meanwhile, a player module 22 is kept standby until the user inputs thecommand for trial listening of the created temporary music data (S200).

Various types of the process for inputting the trial listening commandof the temporary music data may be employed in accordance with thedesign. For example, the user may be allowed to input the triallistening command by clicking the button such as “rewind”, “play”, and“fast-forward” on the screen at the predetermined positions.

Upon input of the trial listening command of the temporary music data,the player module 22 plays the created temporary music data using theMIDI sound source (S201).

Specifically, the phrase data are played in the order of the time linenumber. If the plural phrase data are correlated with the same timeline, they are simultaneously played. The phrase data may be played bythe generally employed MIDI player.

The user acquires the desired phrase data from those shared via thecomposition assisting server 1, and is capable of trial listening themusic having the phrase data incorporated in the music data at the time.

(Set of Phrase Object: FIG. 8)

The phrase object set module 30 of the composition assisting terminal 2which is active is kept standby until the user inputs the command foropening the discussion designating the phrase data (hereinafter referredto as “phrase unit discussion”) on the chat canvas (S300).

The method for inputting the command for opening the phrase unitdiscussion may be determined in accordance with the design. Likewise thecase for inputting the command for downloading the phrase data, thecommand for opening the phrase unit discussion may be input bydesignating the phrase data using the pull-down menu and by clicking thepredetermined command button on the screen.

As the phrase unit discussion is conducted on the chat canvas, thediscussion position has to be specified on the chat canvas. Theembodiment employs a framework that the phrase object is provided on thechat canvas to specify the discussion position for the phrase unitdiscussion. The phrase object may take various structures so far as thephrase data are specified. In the embodiment, the icon indicating theinstrument and the phrase data title are combined to form the phraseobject.

Upon input of the command for opening the phrase unit discussion, thephrase object set module 30 determines the display mode of the phraseobject corresponding to the designated phrase data and the correspondingposition on the chat canvas (specifically, the coordinate value of thechat canvas local coordinate system) so as not to overlap with thedisplay mode and position of the other phrase object (S301).

As discussed in more detail below, the embodiment employs a frameworkthat displaying of data is performed with the display mode different asto each phrase object (that is, for each phrase unit discussion). Themessage text data determined to belong to the same phrase unitdiscussion will be displayed in accordance with the display mode of therelevant phrase object. Various methods can be employed for displayingdata with different display mode, for example, displaying data usingdifferent font can be employed. In the embodiment, the display colorinformation is used as the display mode information and displaying ofdata is performed with the different display color for each phraseobject.

The phrase object set module 30 generates the phrase object data whichcontain the identification information of the designated phrase data,and position information and display color information of the phraseobject on the chat canvas (S302).

Then the phrase object data management module 32 transmits the thusgenerated phrase object data to the composition assisting server 1(S303).

Upon reception of the phrase object data from the composition assistingterminal 2 (S304), the phrase object data management server module 17 ofthe composition assisting server 1 correlates the received phrase objectdata with the corresponding identification information so as to bestored/managed in the phrase object data storage server module 16(S305). FIG. 10 shows an exemplary data structure of the phrase objectdata storage server module 16.

The phrase object data management server module 17 distributes themanaged phrase object data to the composition assisting terminals 2(S306). Preferably, for the composition assisting terminal 2 of the newuser, it distributes the phrase object data which have beenstored/managed for a predetermined period retroactive to the time whenthe user participated in the project collectively among those stored inthe phrase object data storage server module 16.

Upon reception of the phrase object data distributed from thecomposition assisting server 1 (S307), the phrase object data managementmodule 32 of the composition assisting terminal 2 stores the receivedphrase object data in the phrase object data storage module 31 (S308).In principle, the phrase object data storage module 31 can have the samedata structure as that of the phrase object data storage server module16.

When the storage content of the phrase object data storage module 31 isupdated, the chat canvas display module 29 of the composition assistingterminal 2 generates the phrase object corresponding to the phrase dataidentification information contained in the updated phrase object data,and displays the generated phrase object on the chat canvas(specifically, on the display window corresponding to the chat canvas)based on the position information and the display color informationcontained in the updated phrase object data (S309).

FIG. 11 schematically shows a part of the chat canvas which displays thephrase object and the like. Various modes for the use of the displaycolor of the phrase object may be employed, for example, by displayingthe phrase object in the display color. In the embodiment, the areasurrounding the phrase object (the range may be determined in accordancewith the design) is colored with the display color as shown in FIG. 11.

Thus, the user designates the desired phrase data among those shared viathe composition assisting server 1 and opens the phrase unit discussionon the chat canvas as the shared communication space.

(Phrase Unit Discussion: FIG. 12)

The chat data input module 26 of the composition assisting terminal 2which is active is kept standby until the user inputs the chat data(S400).

As mentioned above, the chat data in the embodiment contain the positioninformation of the message on the chat canvas, more specifically, thecoordinate value of the local coordinate system on the chat canvas.

The coordinate value of the local coordinate system may be directlyinput through the keyboard, or input by directly designating the desiredposition on the chat canvas using such pointing device as the mouse. Forexample, upon input of the message through the keyboard first, thecorresponding message text data may be displayed on the predeterminedposition on the screen, thereafter, the user may drag the displayedmessage text data by the pointing device such as the mouse and drop itat the desired position so as to designate the display position of themessage by the drop position.

Upon input of the chat data, the chat data management module 28transmits the chat data to the composition assisting server 1 togetherwith the identification information of the user who has input the chatdata (S401).

Upon reception of the chat data from the composition assisting terminal2 (S402), the chat data management server module 15 of the compositionassisting server 1 stores the received chat data in the chat datastorage server module 14 (S403). FIG. 13 shows an exemplary datastructure of the chat data storage server module 14.

Then the chat data management server module 15 distributes the storedchat data to the respective composition assisting terminals 2 (S404).Preferably, for the composition assisting terminal 2 of the new user, itdistributes the chat data which have been received/stored for apredetermined period retroactive to the time when the user participatedin the project collectively among those stored in the chat data storageserver module 14.

Upon reception of the chat data distributed from the compositionassisting server 1 (S405), the chat data management module 28 of thecomposition assisting terminal 2 stores the received chat data in thechat data storage module 27 (S406). In principle, the chat data storagemodule 27 can have the same data structure as that of the chat datastorage server module 14.

Then the chat data management module 28 extracts the positioninformation of the message from the stored chat data (S407).

The chat data management module 28 refers to the phrase object datastorage module 31 to read the position information of the phrase object,and selects the phrase object at the closest position to the displayposition of the message contained in the stored chat data (position ofthe message text data) (S408). If none of the phrase object is set, thedefault phrase object having the predetermined display color informationset may be selected, for example.

The chat canvas display module 29 displays the message text datacontained in the stored chat data on the chat canvas based on thedisplay color information of the selected phrase object stored in thephrase object data storage module 31, and the position information ofthe message object contained in the stored chat data (S409).

There are various modes for using the display color of the phraseobject. For example, the message text data itself may be displayed inthe display color, or background of the rectangular region fordisplaying the message text data may be displayed in the display color.In the embodiment, the region which surrounds the message text displayarea (the range is determined in accordance with the design) is coloredwith the display color as shown in FIG. 11.

In the embodiment, the message text data on the chat canvas is displayedin the same mode as that of the most adjacently positioned specificphrase object on the chat canvas. Then, when the user who intends tojoin the collaborative composition project posts the message at thelocation close to the specific phrase object on the chat canvas (providethe message text data close to the specific phrase object), thediscussion of the specific phrase object is distinguished from that ofthe other phrase data visually with the different position and displaymode. This makes it possible to allow discussions of the respectivephrase data individually in parallel.

Meanwhile, however the display mode of the phrase object and the messagetext data vary depending on the phrase data, they are displayed on thesame chat canvas. Then, the user can refer to or quote the message textdata with respect to the other phrase data for posting the messageeasily. This makes it possible to conduct the discussion while crossingover the plural phrases.

(Creation, Sharing and Trial Listening of Music Data: FIGS. 14( a), (b))

When the composition assisting terminal 2 is active, the music datacreation module 23 is kept standby until the user inputs the music datacreation command (S500).

The method for commanding the music data creation may be determined inaccordance with the design. In the embodiment, since the music data areformed by correlating the timelines with the phrase data, it is employedthat the time line area for displaying the time lines arranged side byside along the time axis on the screen is provided to allow the user todrag the phrase object displayed on the chat canvas and to drop it onthe time line of the area for commanding the music data creation (seeFIG. 15).

When the phrase object is dropped on the time line as the music datacreation command from the user, the music data creation module 23 readsthe music data stored in the music data storage module 21, andincorporates the combination of the phrase data corresponding to thedropped phrase object and the time line number at the dropped positionin the music data for creating the music data (updating) (S501). If themusic data are not stored in the music data storage module 21, theaforementioned combination will be formed as the new music data.

The music data management module 25 transmits the created music data tothe composition assisting server 1 together with the identificationinformation of the user who has performed the drop operation (S502).

Upon reception of the music data from the composition assisting terminal2 (S503), the music data management server module 13 of the compositionassisting server 1 stores/manages the received music data in the musicdata storage server module 12 (S504). FIG. 6 shows an exemplary datastructure of the music data storage server module 12.

Then the music data management server module 13 distributes the storedmusic data to the respective composition assisting terminals 2 (S505).

Upon reception of the music data distributed from the compositionassisting server 1 (S506), the music data management module 25 of thecomposition assisting terminal 2 stores the received music data in themusic data storage module 21 (S507). In principle, the music datastorage module 21 can have the same data structure as that of the musicdata storage server module 12.

When the music data are stored in the music data storage module 21, theplayer module 22 is kept standby until the user inputs the command fortrial listening of the music data (S600).

The command for trial listening of the music data may be input invarious ways in accordance with the design. For example, each button forrewind, play, or fast-forward etc may be displayed on the timeline areaand the user may be allowed to input the command for the trial listeningby clicking the button.

When the command for trial listening of the music data is input, theplayer module 22 reads the music data stored in the music data storagemodule 21 and plays the music data using the MIDI sound source likewisethe temporary music data (S601).

The user intended to join the collaborative composition project isallowed to create (update) the music data in synchronization with theother user, and to trial listen to the music data.

Variation Example

The present invention is applicable by changing in various manners,without limiting to the aforementioned embodiment. For example, insteadof MIDI employed in the aforementioned embodiment as the format of thephrase data etc, other format such as WAV, AIFF may be employed. In sucha case, the player module 22 can be realized using the generallyemployed player corresponding to the selected format.

In the aforementioned embodiment, the phrase unit discussion isconducted on the chat canvas. However, the discussion other than thephrase unit discussion, for example, the discussion about the music datain general may be conducted on the chat canvas. In such a case, it ispreferable to provide an object indicating the discussion position forthe music data in general so as to be displayed on the chat canvaslikewise the phrase object. Alternatively, a conventional chat window(in which the messages are displayed in descending order of the input)may be provided in addition to the chat canvas such that the discussionother than the phrase unit discussion is conducted on the conventionalchat window. As the user tends to frequently post messages or refer tothe discussion about the music data in general, it is preferable toprovide always a dedicated chat window for discussing such theme on thescreen and to make that dedicated chat window accessible to the users.

In the aforementioned embodiment, the display mode (display color) ofthe phrase object is determined in the composition assisting terminal 2.However, the composition assisting server 1 may execute determinationprocess of the display mode and distribute the phrase object data havingthe determined display mode information inserted, for example.

In the aforementioned embodiment, the phrase object at the closestposition to the display position of the message is selected and thedisplay mode of the selected phrase object is used for that of themessage text data in the composition assisting terminal 2. However, thecomposition assisting server 1 may execute the process for correlatingthe message text data with the phrase object and distribute the chatdata having the identification information or display mode informationof the correlated phrase object inserted, for example.

In the aforementioned embodiment, the composition assisting server 1includes the phrase database 10. However, each of the compositionassisting terminals 2 may include the phrase database, for example. Inthis case, the module to download the phrase data is not required forthe composition assisting terminal 2. However, the framework whichensures that each phrase database of the composition assisting terminals2 has identical content (framework for synchronizing the respectivedatabases on the regular basis) is required.

In the aforementioned embodiment, the user may be allowed to drag anddrop the phrase object and the message text data displayed on the chatcanvas using the pointing device such as the mouse so as to move them tothe desired position on the chat canvas.

When the phrase object is moved, preferably, the message objectdisplayed based on the display mode of the phrase object is determinedas being the message relevant to the moved phrase data, and it is movedwhile keeping the relative positional relationship with the phraseobject (see FIG. 16( a)). The aforementioned structure allows displaypositions of the phrase object and the message text data to be flexiblychanged. This makes it possible to promote crossing over of thediscussions by locating highly related discussions adjacently, and toenhance independency of the discussion by locating low relateddiscussions mutually away. In this way, the respective discussions maybe conducted more appropriately.

Further, it can be employed that, by designating the phrase objectdisplayed on the chat canvas, the user can delete the designated phraseobject and the group of the message objects displayed based on thedesignated phrase object collectively. Alternatively, such group may beretracted to a predetermined retract area on the screen such that thephrase object is only displayed (FIG. 16( b)).

In the aforementioned embodiment, the phrase object at the closestposition to the display position of the message is selected as beingclose to the display position of the message. However, the presentinvention is not limited to the aforementioned structure. For example,the average display position of the phrase object and the message objectgroup displayed based on the phrase object is calculated, and thecalculated position is set as the reference point of the phrase object.The phrase object with the reference point at the closest position tothe display position of the message may be selected as the one close tothe display position of the message.

In the aforementioned embodiment, as to the trial listening of thephrase data, the trial listening method by incorporating the downloadedphrase data in the music data has been described. However, the user isallowed to trial listen to the phrase data itself. For example, when theuser clicks the phrase object displayed on the chat canvas using thepointing device such as the mouse, the player module 22 plays the phrasedata corresponding to the clicked phrase object.

In the aforementioned embodiment, in the composition assisting server 1,the phrase data supply function, the music data storage/managementfunction, the chat data storage/management function, and the phraseobject data storage/management function are implemented. However, eachof those functions or any combination thereof may be individuallyimplemented by the different servers.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a block diagram schematically showing a structure of acomposition assisting system 100.

FIG. 2 is a block diagram showing the hardware and the functionstructure of a composition assisting server 1.

FIG. 3 is a block diagram showing the hardware and the functionstructure of a composition assisting terminal 2.

FIG. 4 is a view showing an exemplary data structure of a phrasedatabase 10.

FIG. 5 is a flowchart of the process for acquisition/trial listening ofthe phrase data.

FIG. 6 is a view showing an exemplary data structure of a music datastorage server module 12.

FIG. 7 is a view showing an exemplary data structure of a phrase datastorage module 20.

FIG. 8 is a flowchart of the process for setting the phrase object.

FIG. 9 is a view showing an example of the phrase object.

FIG. 10 is a view showing an exemplary data structure of a phrase objectdata storage server module 16.

FIG. 11 is a view showing an exemplary display on a chat canvas.

FIG. 12 is a flowchart of the process for conducting the phrase unitdiscussion.

FIG. 13 is a view showing an exemplary data structure of a chat datastorage module 13.

FIG. 14 is a flowchart of the process for creation/sharing/triallistening of music data.

FIG. 15 is a view for explaining the process for creating the music datausing the time line.

FIG. 16 is a view for explaining the movement of the phrase object etcon the chat canvas.

REFERENCE NUMERALS

-   -   1 composition assisting server    -   2 composition assisting terminal    -   10 phrase database    -   11 phrase data supply module    -   12 music data storage server module    -   13 music data management server module    -   14 chat data storage server module    -   15 chat data management server module    -   16 phrase object data storage server module    -   17 phrase object data management server module    -   20 phrase data storage module    -   21 music data storage module    -   22 player module    -   23 music data creation module    -   24 phrase data acquisition module    -   25 music data management module    -   26 chat data input module    -   27 chat data storage module    -   28 chat data management module    -   29 chat canvas display module    -   30 phrase object data set module    -   31 phrase object data storage module    -   32 phrase object data management module    -   100 composition assisting system

1. An assisting apparatus for composition by combining phrases,comprising: an interface configured to receive, from a user, a commandfor opening a discussion regarding a phrase; a processor operativelycoupled to the interface and configured to: form, in response to thecommand, phrase object data which contains at least identificationinformation of phrase data designated by the user, and positioninformation of a phrase object, wherein the position informationindicates a position where a phrase unit discussion is opened on atwo-dimensional region comprising a chat canvas; and generate chat datawhich contains at least text data of a message input by the user, anddisplay position information on the chat canvas; a communication deviceoperatively coupled to the processor and configured to: transmit thegenerated chat data to a server and receive the chat data distributedfrom the server; and transmit the generated phrase object data to theserver and receive the phrase object data distributed from the server;and a display configured to display the phrase object or the messagetext data on the chat canvas based on the phrase object data or the chatdata wherein a display mode of the message text data is determined basedon a display mode of the phrase object located close to a displayposition of the message text data; wherein the processor is furtherconfigured to determine, upon movement of the phrase object, that themessage text data is associated with the phrase object, and move themessage text data along with the phrase object such that a positionalrelationship between the phrase object and the message text data ismaintained.
 2. The composition assisting apparatus according to claim 1,wherein the processor is further configured to acquire the phrase datafrom a database for storing the phrase data in correlation with phraseidentification information based on the command from the user and tostore the phrase data in a memory, and wherein the processor is furtherconfigured to play the phrase data stored in the memory.
 3. Thecomposition assisting apparatus according to claim 2, wherein theprocessor is further configured to create music data by combining theacquired phrase data, wherein the communication device is furtherconfigured to transmit the created music data to the server and receive,the music data distributed from the sewer, and wherein the processor isfurther configured to store the music data in the memory and play themusic data stored in the memory.
 4. A composition assisting systemincluding at least one server and a plurality of terminals, wherein: theterminal includes: a phrase object set module for generating phraseobject data which contains at least identification information of phrasedata designated by a user, and position information of a phrase objectfor indicating a position where a phrase unit discussion is opened on atwo-dimensional region comprising a chat canvas upon reception of acommand for opening the discussion designating the phrase from the user;a chat data input module for generating chat data which contains atleast text data of a message input by the user and display positioninformation on the chat canvas upon reception of a command for inputtingthe chat data from the user; a chat data management module fortransmitting the generated chat data to the server, receiving the chatdata distributed from the server, and storing the chat data in a memory;a phrase object data management module for transmitting the generatedphrase object data to the server, receiving the phrase object datadistributed from the server, and storing the phrase object data in thememory; and a display module for displaying the phrase object or themessage text data on the chat canvas based on the phrase object data orthe chat data stored in the memory; wherein the server includes a phraseobject data management server module for receiving the phrase objectdata from the terminal, storing the received phrase object data in amemory, and distributing the stored phrase object data to the terminal;wherein a display mode of the message text data is determined based on adisplay mode of the phrase object located close to the display positionof the message text data; and wherein the display module is furtherconfigured to determine, upon movement of the phrase object, that themessage text data is associated with the phrase object, and move themessage text data along with the phrase object such that a positionalrelationship between the phrase object and the message text data ismaintained.
 5. A phrase base composition assisting method comprising:generating, with a processor of a terminal, phrase object data whichcontains at least identification information of phrase data designatedby a user, and position information of a phrase object for indicating aposition where a phrase unit discussion is opened on a two-dimensionalregion comprising a chat canvas upon reception of a command for openingthe discussion designating the phrase from the user; generating; withthe processor of the terminal, chat data which contains at least textdata of a message input by the user and display position information onthe chat canvas upon reception of a command for inputting the chat datafrom the user; transmitting the generated chat data to a server,receiving the chat data distributed from the server, and storing thechat data in a memory; transmitting the generated phrase object data tothe server, receiving the phrase object data distributed from theserver, and storing the phrase object data in the memory; displaying thephrase object or the message text data on the chat canvas based on thephrase object data or the chat data stored in the memory, wherein adisplay mode of the message text data is determined based on a displaymode of the phrase object located close to the display position of themessage text data; and determining, upon movement of the phrase object,that the message text data is associated with the phrase object andmoving the message text data along with the phrase object such that apositional relationship between the phrase object and the message textdata is maintained.
 6. A non-transitory computer-readable medium havingcomputer-readable instructions stored thereon, the instructionscomprising: instructions to generate phrase object data which containsat least identification information of phrase data designated by a user,and position information of a phrase object for indicating a positionwhere a phrase unit discussion is opened on a two-dimensional regioncomprising a chat canvas-upon reception or a command for opening thediscussion designating the phrase from the user; instructions togenerate chat data which contains at least text data of a message inputby the user and display position information on the chat canvas uponreception of a command for inputting the chat data from the user;instructions to transmit the generated chat data to a server, receivethe chat data distributed from the server, and store the chat data in amemory; instructions to transmit the generated phrase object data to theserver, receive the phrase object data distributed from the server, andstore the phrase object data in the memory; instructions to display thephrase object or the message text data on the chat canvas based on thephrase object data or the chat data stored in the memory; instructionsto determine a display mode of the message text data based on a displaymode of the phrase object located close to the display position of themessage text data; and instructions to determine, upon movement of thephrase object, that the message text data is associated with the phraseobject, and to move the message text data along with the phrase objectsuch that a positional relationship between the phrase object and themessage text data is maintained.